Usages of DASH for Rich Media Services
0 likes12 views
This document discusses using DASH (Dynamic Adaptive Streaming over HTTP) to deliver rich media services with synchronized audio, video, text, and graphics. It proposes two studies: A) providing an API for manipulating DASH-delivered audio/video in rich media documents while maintaining compatibility with existing languages, and B) delivering rich media streams synchronously with related audio/video by repackaging existing broadcast services over DASH to minimize bandwidth and preserve interactivity. The implementation is discussed using open source GPAC tools to support DASH playback, file segmentation, and muxing.
![Study B: DescriptionGoalDeliverRich Media Streamssynchronouslywithrelated audio/video dataAutomaticrepackaging of existingbroadcast interactive services over DASHRequirementsEnable transposition of the traditional carrousel approachMinimizebandwidth, leverage HTTPPreserveinteractivityUse caseDigital Radio Service [demonstration: http://www.youtube.com/watch?v=Bmer91TZhCo]T-DMB (MPEG-2 TS + MPEG-4 A/V + MPEG-4 BIFS)page 7](https://image.slidesharecdn.com/concolato43-110513095119-phpapp01/85/Usages-of-DASH-for-Rich-Media-Services-8-320.jpg)
Usages of DASH for Rich Media Services
- 1. Usages of DASH for Rich Media ServicesCyril ConcolatoJean Le FeuvreRomainBouqueauMMSys 2011
- 2. Rich Media ServicesServices featuringMultiple media elements audio, video, text, 2D/3D graphicsDynamicity Changing text, animated graphics, …Possibly triggered on server-side (streaming)Synchronization with media elementsInteractivityExample of Rich Media TechnologiesHTML 5, MPEG-4 BIFS, Flash…page 1
- 3. ContextRapid development of HTTP Streaming technologiesMPEG, 3GPP, OIPF, W3C, …Increased usages of Rich Media Technologies Presentation glue for A/V content (HTML+video)Streamed services including live meta-data (SVG/DIMS, MPEG-4 BIFS)page 2
- 4. Research QuestionsHow can Rich Media languages use DASH-delivered audio/video content?Study AHow can Rich Media content be delivered over DASH?Study Bpage 3
- 5. Study A: DescriptionGoalProvide a generic API for MPD manipulations within a rich media documentCompatibility with existing Rich Media languagesHypothesisBandwidth related manipulations are handled at the DASH levelTrick Mode related manipulations may be handledat both DASH and browser levelsRequirements The API shall provide access to:The desired video resolution & frame rateThe desired languageThe desired qualityThe desired view page 4
- 6. Study A: Architecturepage 5BrowserMedia PlayerIntegratedRenderingMedia Elements (audio,video…)Media Selectionand ControlRich Media Elements (HTML, …)DASH ClientHTTP Stack
- 7. Study A: SolutionsUse of fragment identifiersUse of attributes in DASH namespaceUse of ECMAScriptpage 6<video src="dash.mpd#viewpoint=1&width=176&height=144"><video src="dash.mpd"> <track kind=subtitles src="dash.mpd"dash:qualityRanking="1" srclang="en"></video>var track = createTrackFromDASH(‘subtitles’,‘lang’,’en’);
- 8. Study B: DescriptionGoalDeliverRich Media Streamssynchronouslywithrelated audio/video dataAutomaticrepackaging of existingbroadcast interactive services over DASHRequirementsEnable transposition of the traditional carrousel approachMinimizebandwidth, leverage HTTPPreserveinteractivityUse caseDigital Radio Service [demonstration: http://www.youtube.com/watch?v=Bmer91TZhCo]T-DMB (MPEG-2 TS + MPEG-4 A/V + MPEG-4 BIFS)page 7
- 9. Study B: Architecturepage 8IntegratedRenderingBrowserMedia PlayerRich Media Elements (HTML, …)Media Elements(audio, video…)DASH ClientHTTP Stack
- 10. page 9Digital Radio Service Broadcast environmentDigital radio streamAudioData carousel (500 ms)Data carousel (2 s)Live dataDigital radio receivers
- 11. Approach 1:Basic Segmentationpage 10Digital radio stream segments…Media SegmentMedia SegmentSegment the MPEG-2 TS Possiblywith « carousel » alignmentBandwidth inefficient because of carouselNeed to extract « carousel » data out of media segmentsDigital radio stream segments…Initialization SegmentMedia SegmentMedia SegmentData into IS not yetallowed by the DASH standardSignal version numberincrementWithoutrequiring the use of new periodsApproach 2: Initialization Segmentpage 11
- 12. Approach 3: External data referencespage 12Digital radio stream segments…Media Segment with updated data referencesMedia SegmentMedia Segmentwith initial datareferenceswith initial datareferences= HTTP link to= HTTP link to= HTTP link to
- 13. Approach 3:External data references (cont’d)External Data References and Segment formatsNot possible with MPEG-2 TS syntaxPotentially possible with FLUTE or others but highoverheadPossible withDataReferenceBox in MP4Not yetauthorized by the DASH standardAdditionalproblemAvoidcarouselrefresh for DASH clients already « tuned-in »Use of « redundant » signaling in MP4page 13
- 14. AdditionalConsideration:RedundantSignalingpage 14Media Segment #nMedia Segment #n+1No change in « carousel » dataUser interactswith Client 1 and locally changes the Rich Media StateClient 1 requests segment #n+1Client 1 starts and requests segment #nClient 1 processes segment #n including « Carousel » dataClient 1 ignores redundant data (preserved interaction)Client 2 starts andrequests segment #n+1Client 2 processes « Carousel » data
- 15. Study B: Summary of solutions Use of data in Initialization Segment (IS)Under evaluation for DASHUse of external data references (EDR)Requires MP4Under evaluation for DASHUse of redundantsignaling (RS) in MP4 for RM dataAccepted as an MP4 amendmentPossible joint usages:IS+EDR or EDR + RS or IS+EDR+RSpage 15
- 16. ImplementationGPAC Open Source ProjetDASH PlayerSupports MPD and M3U8 playlistsMP4BoxSegmentation tool for MP4 filesMP42TSDVB & DMB MuxSegmentationpage 16